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ABSTRACT 


In computer vision many techniques have been developed for object recognition. 
The affine invariant matching algorithm proposed by Hummel and Wolfson (1988) is a 
new and interesting method. Under affine invariant transformation, objects with trans- 
lation, rotation, scale changes, and/or even partial occlusion will have the same or simi- 
lar coefficients. However, some serious problems exist in the original algorithm. 

This thesis begins with the discussion of the affine transformation. The shortcom- 
ings that can occur in this method such as the basis instability, the collision of hash ta- 
ble, and the noise sensitivity will be discussed. Among them the noise sensitivity is a 
serious problem. This can always cause the recognition procedure to fail. In this thesis 
an improved affine invariant matching algorithm was developed to overcome the noise 
problem and other disadvantages of the original algorithm. 

The area test criteria were adopted to avoid the numerical instability problem. The 
modified hashing structure using a special hash function was implemented to achieve 
faster accessing and voting. In the recognition procedure, the partial voting technique 
with the consideration of false peaks from the voting array highly enhanced the noise 
tolerance of the algorithm. Finally, the results obtained from the improved algorithm 


clearly showed better performance than those of the original algorithm. 
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I. INTRODUCTION 


Recognition of objects in natural scenes is a major subject of study in computer vi- 
sion. It is important in many applications including robotics, automated inspection, and 
aerial photo-interpretation. A number of practical recognition systems are model-based 
systems Where the task is to match known models against the test objects tn the scene. 

Generallv, according to the matching scheme the techniques for 2-D object recog- 
nition can be classified into three categories. They are template matching, feature 
matching, and transform matching. Template matching is the oldest technique known. 
It is basically a technique of 2-D cross-correlation between the model object and the test 
object. In feature matching a structural model of the object in terms of features or ob- 
ject primitives is constructed. Recognition is based on the structure. These features can 
be served as a compact description of the object and can be easily extracted from it. 
The above two matching techniques are performed in the original 2-D spatial domain. 
The last approach 1s to transform the original data into a different domain with the 


matching done in this new domain. [Ref. 1: pp. 14-20] 


The representation method of an object determines the complexity of the matching 
algorithm and also places a limit on the capability of the matching algorithm. For ex- 
ample, a representation based on the Fourier Descriptors can not handle the partially 
occluded objects because of its global Fourier feature. Therefore, an ideal object repre- 


sentation shall have the following desirable characteristics [Ref. 2] : 


e It should be local. This means that the coding of an object is not dependent on the 
entire boundary, nor is it dependent on an external reference point such as a 


centroid or a Starting point. 


e [It should be independent of the orientation, scale, and even partial occlusion of the 


object. 


e It should be bounded. This means that a small change to part of the boundary 


should produce only a small local change in the representation. 
e It should allow for efficient and robust matching in the presence of noise. 
e It should uniquely specify a single object. 


e It should contain information about the object at varying levels of details so that 


the matching process can be performed at different levels of coarseness. 


e It should be computationally efficient. 


These characteristics of object representation are ideal, and it is by no means obvious 


from the outset that a representation with such characteristics can be found. 


Many techniques were developed for object representation and matching in the above 
three categories, but none of them are simultaneously orientation, scale, and occlusion 
invariant. The affine invariant matching proposed by Hummel and Wolfson (1988) is a 
new and efficient transform matching technique which can handle objects with changes 
in scale, orientation. and partial occlusion. However, this technique has some short- 


comings. 


The purpose of this thesis is to discuss these shortcomings and derive the solutions 
to overcome the corresponding problems. There are five chapters included in this thesis. 
Chapter I is a brief description of 2-D object recognition and the ideal representation 
characteristics. Chapter II presents the principle of affine invariant transformation and 


its Original implementation on point matching. In Chapter III the emphasis 1s on the 


discussion of the shortcomings of the original matching algorithm such as the basis in- 
stability, the collision of hash table, and the noise problem. Then, solutions were derived 
to overcome these problems. Among these shortcomings, the main weakness of the or- 
iginal matching algorithm Is its sensitivity to noise perturbation. This will always cause 
the recognition procedure to fail. One side effect caused bv the solution to reduce noise 
perturbation is that the matching algorithm suffers from false peaks in the accumulator 
array due to the partial voting technique. All the problems and solutions will be dis- 
cussed in detail in this chapter. In Chapter IV, these solutions were implemented in the 
improved affine matching algorithm in order to enhance some of the ideal characteristics 
of the object representation and matching algorithm. Hence, the new algorithm can 
work better in a real situation. In other words, 1t can handle noisv test objects and still 
preserve scale, orientation, and occlusion invariance. Chapter V shows the results ob- 
tained from the computer experiments. By comparing the results reported here with the 
results of the original algorithm, the new algorithm clearly shows better performance 
tian the original method. Finally, Chapter VI presents the conclusions and the rec- 


ommendations for future study. 


II. DISCUSSION ON AFFINE INVARIANT MATCHING 


A. AFFINE TRANSFORMATION OF PLANAR POINTS 
1. General Statement 

From a theoretical as well as a practical point of view, feature transformation 
is an important topic in object recognition. The affine transformation is a new method 
to characterize objects with invariance in respect to translation, rotation, scale change, 
and partial occlusion. But the most important characteristic of all is the simplicity of 
this method. 

The study is concentrated on the recognition of 2-D flat rigid objects. Under 
this restriction. two different images of the same flat object are in affine correspondence, 
l.e., there is a non singular 2 x 2 matrix A and a 2-D (translation) vector b, such that 
each point xX in the first image can be translated to the corresponding point Ax + bin 
the second image. Our problem is to find the correspondence of the objects in a scene 
and a stored model in the data base. [Ref. 3: pp. 3-4] 

In order to identify the occluded or overlapped objects, a local feature must be 
used. Local features depend onlv on the shape or structure of the object restricted to a 
small area. In the study here the local point feature 1s used. 

2. Transform Representation 

It is well known that anv three non-collinear points (called a triplet or a basis 
triplet) can uniquely specify a plane. Consequently, affine transformation of a plane is 
associated with the transformation of three non-collinear points. Moreover, the affine 
transformation is unique because it maps anv non-collinear triplet in one plane to an- 


other non-collinear triplet in the other plane. 


Suppose a set of points (called interesting points) of an object is extracted from 
an image. Any three non-collinear points of the set forma triplet. The affine coefficients 
(€,7) of the rest of the points of the object can be calculated based on this particular 
triplet. The most important characteristic of this transform 1s that for each non-collinear 
triplet the affine coefficients of all other points of the object are affine invariant. In 
other words, the same point of the object transformed on different basis will have the 
same affine coefficients. 

Let a, b, c denote the vectors of a selected triplet of the plane, and T denotes the 
transformation to a different plane. As shown in Figure 1, one can express the affine 


coefficients (¢, 7) of an arbitrary point p by the following equation : 


("= t-« fb SO) Se eal 


Qa, b, C, a 
merc 2 = =( e=( )- sna p= (7 ; 
ay b, Cy yy 


Hence, given the affine coefficients and the triplet, the corresponding point in 


an image can be computed by 
p=¢é(a—c)+y7(b—c)+e. (2.2) 


If both the point p and its triplet are transformed by T to a new image plane, 


its new affine coefficients are 


z 

( : =(T(a—c) T(b—c))'Tip—e) 

"= (Ta-¢ b-oy'Tip-0) 
=(a—c b—c) T'T(p—c) 


=(a-—c qn te) 


From equations (2.1) and (2.3), it 1s clearly proven that the affine coefficients 
are transform invariant [Ref 4: pp. 3-4]. Figure 1 shows the invariant property graph- 


ically. 


B. ORIGINAL MATCHING ALGORITHM 

As was mentioned in the previous section, given a triplet, each point of the plane 
can be represented as a coefficient pair (¢, 7) on this basis. Since there is no preference 
for any specific triplet, the set of model interesting points from the model can yield a 
large number of non-collinear triplets. Given m interesting points of the model at least 
CrP}— N cases should be considered, where N is the number of undesired collinear 
triplets. For object recognition considered here, interesting points of a test object is 
goimg to be used to match those of the stored models. If there are n points in the test 
object, the worst case complexity for recognition using this method ts (077 x 1)? x ¢, where 
t is the complexity of verifying one point of the model against that of the test object. 
Again if n and t are mn the same order of magnitude as m, the worst case complexity 
could be of order nv’. [Ref. 3: pp. 6] Such a complexity is quite unfavorable. lence. it 
is necessary to divide the algorithm tnto two different steps. The first one 1s an off-line 
step called preprocessing, and the second one is an on-line step called recognition. The 
objective here is to identify the test object in a scene as one of the possible modcls 
stored. The two steps are explained briefly as follows. 


1. Preprocessing (Off-line Step) 
a) Represent the model objects by a set of interesting points. 


b) For each non-collinear triplet, calculate the coefficients (€, 7) of all the other model 


interesting points on this basis triplet. 


c) Use these coefficients by hashing them into an entry of a table (called hash table). 


The entry stores all the corresponding pairs (modelno, tripletno) for those afline co- 





Figure 1. Affine invariant characteristic 


efficients (€, 27). Within the hashing structure all entries with the same coefficients are 


linked together by pointers. 


d) This is done for as many models as necessary, 1.e., for each different model repeat 


procea@unes a) lO a). 
2. Recognition (On-line Step) 
a) Input a set of interesting points of the test object in an image. 


b) Choose a non-collinear triplet as a basis, compute the coefficients (€, 7) of the other 


points based on this triplet. 


c) For each coefficient pair (€,7), the hash table is accessed and a vote for the ap- 


propriate entries 1s tallied. 


d) If a certain entry in the hash table obtains the largest number of votes, the data 


related to this entry can be reconstructed and shown on the display. 
e) Check another model as necessary, 1.e., repeat procedures a) to d). 
This two-step algorithm 1s illustrared in Figure 2. 


C. SHORTCOMINGS OF AFFINE INVARIANT MATCHING 

Besides the disadvantage of complexity, there are other shortcomings that limit the 
accuracy and efficiency of the scheme. These shortcomings are discussed in the follow- 
ing. The solutions to these problems will be the subject of the next section. 

1. Basis Instability 

In order to understand the basis instability problem it 1s advantageous to inter- 

pret the affine transform from the geometrical point of view. It is possible to rewrite 
equation (2.1) in terms of the components of the coordinates of vectors a, b, c, and p as 


follows 
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Figure 2. Flow chart of the affine invariant matching algorithm 
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\Viore explicity the affine coefficients are given by 
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and 


(a, — CxMPy a cy) = (Bes €x)(a, — e) 


TS (a — eb, — 6) — (be — CMa — 6) | 


(2.4) 


(2.5) 


(2.6) 


If equations (2.5) and (2.6) are interpreted from the geometrical point of view, 


te affine coefficients € and 7 are both ratios of areas. The area of the basis triplet tri- 


angle is given by 


OPN 28h, l 

| 
(ae = De b,. by | 
Cc. c, | 


The determinant can be simplified to 


l 
ne - et 





On Ce iG 


Or 


(2.7) 


(2.8) 


Aave = | > [ax = Ca)(by = G) = (be = EN, - 6) (2.9) 


which is identical to the magnitude of the denominator of equations (2.5) and (2.6), ex- 
eept for the 1/2 factor. 

In other words, the denominator of equation (2.5) or equation (2.6) is propor- 
tional to the area of the triangle for which the vertices are the three non-collinear basis 
points a, bande. Similary, the numerator of € is proportional to area A,,, which 1s the 
area of the triangle that consists of points b, c, and p. The numerator of 7 1s propor- 
tional to 4,,, which is the area of the triangle that consists of points a, c, and p. 
Figure 3 shows the geometrical interpretation of the affine transformation. 
or A 


If the area of A,,. 1S too small compared to the area of A the magnitude 


bpe cpes 


of the affine coefficient will be a verv large number. This effect will cause the numerical 
instability in the affine plane. [Ref. 4: pp. 6-7] 
2. Collision of Hash Table 
Even if the unstable triplet points are ruled out, the values of € and 7 tend to 
concentrate highly around zero, 1.e., these values are closing toward the origin of the 
affine plane, as shown in Figure 4. These small values of € and 7 will generate many 
long linked lists in the hash table, which causes serious collisions of entries in the table. 
Under this circumstance, the hash table accessing time increases, and the situation be- 
comes impractical due to the numerous collisions. Thus, a special function which can 
distribute these small values to a large region is needed. 
3. Noise Perturbation 
When the test object appears in a real scene, usually the extraction of local 
feature (interesting point) is inaccurate to a certain extent in the presence of random 
fluctuations or “noise”. In this scheme the local feature used is a set of fixed-value co- 


ordinates of the interesting points. If these points are perturbated in the presence of 





Figure 3. Geometrical interpretation of affine transformation 


noise, the corresponding affine coefficients € and y will deviate from the accurate values 
in the affine plane. 

In order to show how the affine coefficients are affected by the noise, it 1s ben- 
eficial to take a look at a simple example as shown in the following. If the coordinates 


of a test triplet <a, b,c> and an arbitrary point p are given by 


= 
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(c) 


Figure 4. | Histograms of the affine coefficients: (a) original; (b) ruling out un- 


stable triplets; and (c) same as (b) with x axis scaled to smaller range of 


values. [From Ref. 3: pp. 8] 
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Using equations (2.5) and (2.6), we have 


Assume that the point vectors b and p are perturbated by the presence of noise and that 


their coordinates change to 


oI 40.5 
b — p = 
BES 1] 


Again, by using equations (2.5) and (2.6) 


é°=0.875, 9 =—2, 


so that the deviations 


— €'=0.875, An=y-—7n' =0. 


Since the affine coefficients of the model interesting points are integer values, 
the above small deviation will cause an erroneous or a failed match in the hash table. 
Figure 5 shows the voting results of the accumulation array in the hash table. 
From this plot it can be seen that the votes of most triplets decrease due to the noise 
perturbation. This means that potential erroneous matching can occur in the hash table. 
Obviously, the affine transformation of a point is very sensitive to noise per- 
turbation. This will alwavs cause the recognition procedure to fail. For real images the 


background noise is inevitable. Hence, the noise sensitivity of affine transform matching 


is the main problem to be solved in this study. 
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Figure 5. Voting results of the accumulation array in the hash table 


Number of the accumulation array 


D. SOLUTIONS TO THE PROBLEMS 
This section discusses the solutions to the shortcomings of the affine matching al- 
gorithm. 
1. Screening to Reduce Numerical Instability 
The selection of triplets 1s an important step in either the preprocessing or the 
recognition procedures. Ifa triplet yielding a relatively small area is used as a basis, it 
will cause large amplification of noise in the affine plane, 1.e., the error of € and 9 will 
become very large. Therefore, the solution to the instability problem is to rute out this 
kind of undesirable triplets. 
The concept of “relatively small area” 1s an ambiguous idea. It can vary from 
object to object. [t is necessary to explain this in detail. In order to get a reflexible 
criterion, the triplet’s area 1s compared with the total area of the object. The following 


restrictions are required for both the preprocessing and the recognition [Ref. 4: pp. 8]. 


e Inthe preprocessing step, only the non-collinear triplet with an area of at least 1/20 


of the total area of the object will be used. 


¢ In the recognition step, the non-collinear triplet used should have at least 1/10 of 
the total area of the object. Here, adoption of the factor 1/10 instead of 1/20 is due 
to the consideration of noise perturbation in the recognition step. Because the in- 
put image 1s alwavs affected by the background noise, a less stringent tolerance is 


adopted. 


By ruling out these undesirable triplets, not onlv can the numerical instability 
problem of this scheme be solved, but also the bounds of coordinates in the affine plane 


can be determined. This results in a smaller and efficient hash table. 


16 


2. Hashing Function 

From the observation of the affine coefficients 1t can be seen that the higher 
concentration occurs at small values, 1.e., values of € and 7 close to the origin of the 2-D 
affine plane. The phenomenon of the concentration of small values of affine coefficients 
induces many long linked lists in the hashing table. Consequetly, the accessing time of 
che hash table in this algorithm deteriorates. Thus, it is intuitively beneficial to use a 
special hash function to scatter those small values as far apart as possible in the affine 
plane. 

Besides the linear hash functions with bad performance, there are some non- 
linear hash functions with a good performance available, such as atan, asinh and tanh. 
Figure 6 shows these functions. From the experimental results, atan seems to be the 
best One as it can scatter the small affine coefficients over a wide range of the affine 
plane [Ref. 4: pp. 9-10]. Hence, the size of the linked list can be reduced through ap- 
Oropriate quantization in the affine plane. The hashing concept and the quantization 
problem will be discussed in the next section. 

3. Noise Problem 

The affine invariant matching algorithm 1s very rigid in calculating the coeffi- 
cients € and. If the coefficient pairs are based on noisy interesting points, the recog- 
nition will fail due to the error matching in the hash table. Consequently, the noise 
sensitivity of this matching system is a serious problem. In order to solve the disad- 
vantage of noise sensitivity, some techniques to improve this main problem are pro- 
posed. 

a. Quantization in the Affine Plane 
In the original algorithm the hash table can be considered as a two 
dimentional array of pointers, each pointer points to the entry with the same affine co- 


efficients. Hence. the implementation of the hash table is essentially quantization of the 


ie 


— 


— 
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Figure 6. Hashing functions of atan, asinh, and tanh 
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affine plane with infinite number of bins (or buckets). Each bucket in the hash table 1s 
indexed by the quantized coefficients (€,7). But, the original approach has a lot of 
shortcomings as mentioned before. In order to tolerate the noise perturbation on the 
test image, a quantization with finite number of bins is necessary. 

Generally speaking, the bigger the table size, the better the spatial resol- 
ution of the quantization. However, under the consideration of noise perturbation there 
is actually a trade-off between the total number of bins and the bucket size. Although 
using a smaller total number of bins can tolerate more noise perturbation, longer linked 
lists will increase the accessing time of the hash table. If the quantization bin size is 
reduced, it will be difficult to survive in the presence of noise. After trying manv bucket 
sizes and total number of bins in different cases, the same conclusion as Costa, Haralick, 
and Shapirp [Ref. 4: pp. 10-11] was reached, 1.e., there 1s no optimal hash table size that 
can work well for all data. The table size used here for all experiments was 90 x 90. 

Before spatial sampling the affine plane, the bounds for both the coefficients 
€ and w should be known. According to the assumptions made in the first section of this 
chapter, the maximun and minimum values of the affine coefficients can be calculated. 
Referring to Figure 7, the bounds of € and y can be derived as follows. 

The image plane has a spatial resolution of 512 x 512. Points a, b. c make 
up a set of non-collinear triplet, and p is an arbitrary point on the same plane. In order 
to find the maximun and minimun bounds on & and 7, the worst cases shown in 
Figure 7 are considered. Assume A is the area of the input object. The triplet is at the 
lower left hand corner, and the arbitrary point is at the upper right hand corner of the 
image plane as shown in case (a). In case (b) the position of the triplet and the arbitrary 


point are reversed. Let the magnitude of both the vector ca and the vector cb equal to 


A , which equals e 10 


equation (2.6) for case (a) yields 


due to the previous restriction. Using equation (2.5) and 
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Figure 7. Calculation of the bounds of affine coefficient 
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Having the bounds on €, 7 and the 90 x 90 table size, it is possible to compute the bin 


width AE and Ay as follows 








2 atan( ir ) 
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b. Improved Hash Structure 

Hashing 1s an efficient technique for address calculation. Sometimes, it 1s 
also called a randomizing or scrambling method. In this technique the item’s feature 1s 
converted into a near-random number, and this number is used to determine where the 
item 1s going to be stored. Within the hash table every item is associated with an affine 
coefficient pair. Bv using the atan hashing function and the 90 x 90 spatial quantization 
the original entry index (€, 7) is replaced by the pair (a, }). 

In the remainder we discuss how to use the index (1, J) to generate the entry 
key and how to convert the kev into a more or less random number uniformly distrib- 
uted in the hash table. In the following discussion the entry key 1s called an inkey, and 
the random number 1s called a hashkey. 

(l} Generation cf inkey. The hash table 1s a two dimentional structure 
indexed by (i, }), and an inkevy is a one dimentional vanable. Conversion of (1, }) to an 
inkey Will cause colhsion of entries. In order to reduce this kind of colhsion, two differ- 
ent one-to-one functions with appropriate operations are used. For simplicity, the inkey 


can be computed in the following equation with tan 30° and tan 20° as the two factors, 


inkey’ = ix tan 30° +) x tan 20°. (2.16) 


The two terms in the above equation are two different one-to-one functions so that 1, } 
in the equation can not commute with each other and keep the same value of inkey’. 
Due to this characteristic the number of colhsions in the hash table can be reduced. On 
the other hand, the value from the above equation is a real number, and to avoid the 
trunction error this number 1s multiplied by 100 before the trunction. Hence, the 


equation for inkev becomes 


inkey = trunc(inkey’ x 100). (29) 


eo 
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(2) Generation of hashkey. Given the inkey, it can be converted to a 
hashkey. There are many kev-to-address conversion algorithms, such as mid-square 
method, dividing, shifting, folding, and digit analysis ... etc. From the experimental 
conclusion of manv researchers, the best choice is the simple division method. [Ref. 5] 
Using this method the inkey is divided by a prime number which 1s approxmately equal 
to or less than the number of the total hash table entries, and the remainder is taken as 
the relative bucket number, i.e., the hashkey. The generation of inkey and hashkev is 
illustrated in Figure §&. 

c. Partial Voting 

The noise sensitivitv problem can be lessened bv using a hash table where 
the bucket size is not very fine. The table size chosen was 90 x 90. In addition, it 1s still 
possible to improve the matching algorithm by using the partial voting technique. In 
this technique eight-neighbor mesh as shown in Figure 9 is used where each bin has the 
corresponding voting weight. For each interesting point Whose quantized affine index 
1S (1, }), One vote is counted for the entries (modelno, tripletno) associated with the 
bucket (1, }) and all the eight neighbors of that particular bucket will also receive partial 
votes. For example, entries associated with bucket (1-1, j-1), (1-1, }+1), G41, j-1) and 
Pemine}| = 1) will each recerve a 0.25 vote; entries for bucket (1-1, }), (i, j-1), @, j+ 1) and 
(i+ 1, }) will each receive a 0.5 vote [Ref. 4: pp. 11]. As a result of partial voting there 
will be some false peaks appearing in the two dimentional accumulation voting array. 
The entrv which received the maximun votes may not be the one of interest. In order 
to get rid of these false peaks an additional verification procedure must be considered. 


The verification procedure will be discussed in the implementation of the algorithm. 
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Figure 8. Generation of inkey and hashkey 
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Figure 9. Partial voting technique 


Il. ALGORITHM IMPLEMENTATION 


From the discussion of the previous chapter the affine transformation is known to 
be a verv effective method for object detection at different views, although a great deal 
of computation is needed in the process. This makes the affine transformation technique 
impractical unless the complexity can be reduced. Hence, the algorithm was divided into 
two steps. The first step is the preprocessing at which data-base representation of 
models is built. This step does not involve any information from the test scene. It is 
executed off-line before the recognition. The second step is the recognition at which the 
data-base is used to match the models against the test objects. With the suggested 
two-step scheme, it is possible to keep the complexity of on-line computations low. As 
discussed in the previous chapter it 1s necessary to solve some major problems of the 
algorithm, such as the basis instability, the collision of the hash table, and the noise 
sensitivity. The solutions to these problems were proposed. The implementation of this 
improved two-step algorithm is discussed in the following. The Pascal source code of 


all modules is hsted in Appendix A. 


A. PREPROCESSING (DATA-BASE SETUP) 
This off-line step has four modules which are explained separately. The operations 
of the preprocessing step are shown 1n Figure 10. 
I. Rule Out the Undesired Triplets 
This module solves the numerical instability problem by ruling out the trouble- 


some triplets. The following procedures are included. 
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Figure 10. Flowchart of the preprocessing step 





a. COMBINATION 
This is a recursive procedure which generates all possible combinations of 
triplets from a set of input interesting points. If there are m interesting points, the total 


number of combinations will be 


mint — 1) — 2) 


C; — a (328 


For each combination generated this procedure will call the SELECTION procedure. 
by SELECTION: 

This procedure screens the triplet passed from the COMBINATION pro- 
cedure. If the area of this triplet is less than one twentieth of the corresponding model 
area, it Will be bypassed and the control returned to the COMBINATION procedure for 
a new triplet. If the triplet area is greater than or equal to this value, then the control 
will go to the PERMUTATION procedure. Since a triplet passing the area test 1s also 
a non-collinear set, no additional collinearity test 1s necessary in this procedure. 

c. PERMUTATION 

The order of points of the selected triplet is important, because a different 
order of the same triplet can generate different affine coefficients. Hence, this procedure 
considers all the permutations of the selected triplet, 1.e., every triplet has P} = 6 per- 
mutation cases. 

2. Calculation of Affine Coefficients 
For a given triplet <a, b, c>, this module calculates the affine coefficients 


(€,7) of all other points p, based on this triplet, that 1s 


) * an bx)(bx oe ae ae . 
= (3.2) 
Nj (Gy = G00) ar) a 


moere i= 1. 2, 3,.., 71 — 3. 

According to the above equation this module includes several matrix operation 
modules. The INVERSE computes the inverse matrix in the equation, and the 
MATRIX-MULT multiplies this inverse matrix with the other matrix to get the affine 
coefficients € and 7. 

3. Quantization of the Affine Plane 

In order to tolerate the noise perturbation, a 90 x 90 table-size was used based 
on the previous discussion. This means that the affine plane can be divided into 8100 
different bins, where each bin is indexed by (1, j). Two procedures are called in this 
module, namely, SCATTER and QUANTIZATION. 

a. SCATTER 
Before quantization, an atan was used as the hashing function. This special 
function can scatter the affine coefficients € and 7 over a wide range in the affine plane 
to avoid the collision in hash table due to the concentration of affine coefficients. So, 


the scattered affine coefficients are 


é = atan(£) (3.3) 
9 = atan(n). (3.4) 


b. QUANTIZATION 
From equations (2.12), (2.13), and the assumed values of A, it 1s possible 
to calculate the bounds on the affine coefficients. Since a 90 x 90 table-size was used, 
the quantization index (1. }) for all affine coefficient pairs (€, 7) can be calculated as in 


the following : 


é 
kl Te (3:5) 


k2 = Te (3.6) 
2 atan( lol ) 
Walehe ec — 7 — a , 
for k1>0 
i= trunc(kl) + 46 (3a7) 
fOr lea) 
i= trunc(kl) + 45 (3.8) 
for kK2>0 
J = trunc(k2) + 46 (3 
for k2<0 
J = trunc(k2) + 45. (3a) 


4. Hash Table Generation 
The purpose of this module is to create a hash table which can be stored in the 
data-base to identify the test objects from the scene. There are three procedures in this 


module as detailed below. 
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a. KEY-CONVERSION 
Since the two-dimensional index (1, }) is not a numeric key, it can be con- 
verted into a numeric form for the convenience of implementation. The conversion 
should be done with the least collision of entry and without losing information in the 
kev. Equation (3.11) was selected to meet the above requirements. This procedure uses 


it to generate the inkey. 


inkey = truncL(i x tan 30° + x tan 20°) x 100 J. rll) 


In a good hash table, the inkey should be distributed as evenly as possible 
over the range of the table size. The KEY-CONVERSION procedure uses the simple 


method of division to convert the inkey to a hashkey, 1e., 


hashkey = inkey rem N., (3212) 


+ 
‘4p 


where rem is the operation of reminder and N is the prime number that is approximately 
equal to or less than the size of the hash table. 
b. HASHING 
To setup the hash table, all the records of interesting points have to be put 
into the table as entries and each record with the same inkey will be linked by pointers. 
MijewtaSiii NG procedure checks to see whether the entry in the hash table accessed 
by the hashkey 1s empty. If it is, then insertion of this input record into the hash table 
will be done right away. Otherwise, it will invoke the COLLISION procedure. 
c. COLLISION 
The link field of every entrv in the hash table indicates whether the entry is 
occupied or not. If the entry is empty, its link field was set to -1. If the accessed entry 
in the hash table is not empty, this procedure will find the next available slot for the in- 


put record. Then, it will put the relative address (hashkey) of the new slot into the link 


ol 


field of the previous one which has the same inkey. After all the records are entered, the 
hash table linked by pointers is established. Figure 11 illustrates the structure of the 


hash table. 


B. RECOGNITION (IDENTIFICATION OF TEST OBJECTS) 

After the preprocessing step 1s accomplished, a set of interesting points of the test 
objects can be processed to identify the unknown objects in the recognition step. There 
are three modules involved in this off-line step. The operation of the recognition step 
is shown in Figure 12. The following is a discussion of these steps. 

1. Calculation of Input Data 

This step is similar to part of the preprocessing step except that there is a dif- 
ference in the hash table. Here, only input affine coefficients based on stable basis 
triplets need to be calculated. Since the noise perturbation is inevitable in the input 
image, sensitivity 1S an important issue here. In order to ensure the tolerance to a noisy 
environment, the criterion factor 1/20 of the area in the SELECTION procedure oii 
preprocessing step was replaced by the factor 1/10. The triplet area should be at least 
1/10 of the total area of the test object, otherwise the triplet will be rejected. The output 
of this module is a data file called rally. Figure 13 shows the structure of the tally file. 

2. Affine Matching 

This matching module is an important part in the recognition procedure. Partial 
voting technique was implemented to generate all the candidate data. The following 1s 
a discussion of the procedures included in this module. 

a. PARTIAL VOTING 
For a given interesting point, this procedure checks all the nearby afhine 
coefficients in the tally file. After quantization, every affine coefficient pair (&, 7) be- 
longs to a corresponding bucket indexed by (i, j). Therefore, the matching procedure is 


nothing but a mapping between the tally file and the hash table. If there is a match, 
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Figure 11. Structure of the hash table 
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Figure 12. Flowchart of the recogniton step 
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Figure 13. 9 Structure of the tally data file 


every entry associated with the bucket (1, j) will receive one vote. Since the partial voting 
technique was used to tolerate the noise perturbation, the eight neighbors of the bucket 
(1,] ) will receive partial votes, 1.e., entries associated with buckets (1-1, j-1), (i-1, }+ 1), 
(i+ 1, j-1) and 4+], j+1) will receive a 0.25 vote; entries associated with DUCKetSsGme 
}); G, 3-1), -G, y# 1) and (i+ 1, }) will receivers 02s" vere 

When all the entries in the tally file are matched in the procedure, the cor- 
responding voting array of the affine coefficient pair will accumulate all the votes it has 
gotten during the campaign. In ideal noise-free case, the entry that received the maxi- 
mum votes indicates an exact matching between the test object and the data-base model. 
But in the noisy case, the result is different. In the latter case partial voting technique 
was applied to reduce the noise perturbation problem. It is evident that some voting 
array bins will receive extra votes due to the multiple voting. Some false peaks may 
appear in the voting array as the by-product of the partial voting technique. Therefore, 
the entry which received the maximum votes may not be the desired candidate. This 
kind of problem will be treated in the following procedures. 

b. TOP-SIX-MAX 

One way to solve the false peak problem is to conduct additional tests on 
all the entries after partial voting. But, it 1s nmpractical because of the long processing 
time. Another approach is proposed based on the fact that the false entries may some- 
times recelve maximum Vote, but the true ones should have votes close to the false peak. 
Based on the experimental experience, the first six highest number of votes are chosen 
to select the suited entries in the hash table. This procedure essentially finds the top six 


maximum number of votes. 
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c. ALL-MAX-SELECTION 
In this procedure all the entries which satisfy the above criterion will be se- 
lected. Since only a small amount of entries will be checked instead of all the ones in the 
next procedure, this method can save a lot of operation time in the recognition step. 
d. CHECK 
This CHECK procedure will test all the entnes sent from the 
MAX-SELECTION procedure. After all the redundant entries are deleted, the appro- 
priate ones are picked by going through a TEST sub-procedure included in this module. 
The qualified entries can be considered as the candidate data. | 
3. RECONSTRUCTION 
This module does the inverse affine transformation to calculate all the interest- 
ing point sets of the qualified candidate triplets. 
4. VERIFICATION 
Since not all the candidate interesting point sets are correct, the purpose of this 
module 1s to check all those interesting point sets until finding the correct one. Finally, 


the identified images will be displayed on the screen. 
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IV. EXPERIMENTAL RESULTS AND PERFORMANCE 


Presented in this chapter are the computer simulation results and the experimental 
performance of the improved affine invariant matching algorithm. These experimental 
tests reconfirmed the affine invariance of this algorithm. It also showed the improved 
noise characteristic which 1s the main problem of the original algorithm. Since our studv 
is concentrated on the algorithm improvement. models and test objects were generated 
artificially in the computer. There are two different sets of data used in the experiments. 
For the convenience of explanation, the first set is referred to as SET1 which consists 
of two simple objects, and the second one is referred to as SET2 which consists of two 


complicated objects. Figure 14 shows these two sets of models. 


Aw SNOISE-PREE FESES 
First, an ideal noise-free situation 1s considered. The model objects in SET1 and 
SET2 are undergone similarity transformation. Occlusion is also evident in the test ob- 
jects. The main objective is to check the affine invariant characteristics of the algorithm, 
1.€., rotation, translation, and scaling. The abilitv to detect occluded object will also be 
tested. 
1. Similarity Transformation Test 
The unknown test object of SET] is used as the input of the algorithm. The test 
object and the recognized object of SET1 are shown in Figure 15. Figure 16 shows the 
same kind of test for SET2. This is a case where the recognition of models from the test 
objects with rotation, translation, and scaling are demonstrated. 
2. Occlusion Test 
A composite overlapping scene consists of two different test objects can be 


identified through the affine invariant matching algorithm. Furthermore, one vertex 
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Figure 14.  Data-base models of SET I(above) and SET2(below) 
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Figure 15. 9 Similarity transform test of SET1 
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Figure 16. Similarity transform test of SET2 
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point of the polygonal shape is missing for the test objects of SET] shown in 
Figure 17. Two polygonal vertices for the test objects of SET2 are also missing in Fig- 
ure 18. The test results of SET] and SET2 are also shown at the bottom in Figure 17 
and Figure 18, respectively. From the reconstructed results of SET) and SEI 23a 
obvious that the hidden vertices of the test objects in both cases can still be recognized 


because of the special characteristic of the algorithm. 


B. NOISE PERTURBATION TESTS 

In this section the test objects will be identified in scenes with noise perturbations. 
In usual situations a filter can be applied to remove most of the noise. But in reality, 
some Vertex points will still have small errors after the extraction procedure. It was 
noted in the previous chapters that the affine invariant matching algorithm was very 
rigid in calculating the coefficients € and y. If the coordinates of some vertex points 
changed a little in the presence of noise, the affine coefficients based on these noisy co- 
ordinates would deviate from the true positions in the affine plane. Even if the error of 
the extraction 1s very small, it can cause the original recognition step to fail. This 1s due 
to the erroneous matching occurred in the hash table. 

The tests conducted in this section showed the noise tolerance of the improved al- 
gorithm. According to the limits of the the affine plane resolution and the inask size of 
the partial voting, the allowable maximum error in the vertex extraction is about Vo. 
This means that the error region of the interesting point is a circle with a center on the 
point and a radius equals to ,/2 as shown in Figure 19. The variation of the vertex 
mav fall inside or on the circle. In the following tests onlv the worst cases are consid- 
ered, 1.e., the test objects are occluded and some of its interesting points are disturbed 
by the noise. 

Figure 20 shows the plot of the test objects of SET1 with four interesting points 


disturbed. Figure 2] shows the recognition of SET] with four interesting points dis- 
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Figure 17.  Occluded objects test of SETI 


43 











Ee RECOGNIZED OBJECIS 





Figure 18. Occluded objects test of SET2 
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Figure 19. Error region of the disturbed interesting point 
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Figure 20. Plot of the test objects of SETI with four interesting points disturbed 
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Figure 21. Recognition of SETI with four interesting points disturbed 
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turbed. Figure 22 shows the plot of the test objects of SET2 with six interesting points 
disturbed. Figure 23 shows the recognition of SET2 with six interesting points dis- 
turbed. Figure 24 shows the plot of the test objects of SETI with seven interesting 
points disturbed. Figure 25 shows the recognition of SET! with seven interesting points 
disturbed. Figure 26 shows the plot of the test objects of SET2 with ten interesting 
points disturbed. Figure 27 shows the recognition of SET2 with ten interesting points 


disturbed. 


C. PERFORMANCE 

By inspecting the results of our experimental tests, it 1s evident that almost all of the 
limitations of the original affine matching algorithm have been improved. The old 
problems include the numerical instability, the collision of hash table, and the noise 
sensitivity. Since the modified hash structure was used, the problem of hash table colll- 
sion due to nonuniform hashkevs was greatly reduced. Consequently, about 1300 ms 
of CPU time was saved in the recognition step of the noise free tests. Initially, the ort- 
ginal algorithm is very sensitive to noise and fails in noisv tests. In order to increase the 
tolerance to noise perturbation, a quantized affine plane with 90 x 90 resolute cells was 
chosen. After the quantization, the partial voting technique was also used to select all 
the qualified candidate triplets. Finallv, in the verification procedure the identified 
object(s) was displaved on the screen. For the improved algorithm the noise tolerance 
is enhanced by a factor of 70%, 1.e., even when seventy percent of the interesting points 
of the test object are disturbed, the improved algorithm can still identify the test objects. 

There 1s a trade-off between the processing speed and the noise tolerance. To have 
more noise tolerance, the partial voting technique is used. This will decrease the speed 
and increase the complexity of the algorithm. Therefore, the processing speed of the 
improved algorithm is still highly dependent on the number of interesting points in the 


test object. Another existing limitation of the algorithm is that only objects with small 
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Figure 23. Recognition of SET2 with six interesting points disturbed 
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Figure 25. Recognition of SET! with seven interesting points disturbed 
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Figure 26. _—_— Plot of the test objects of SET2 with ten interesting points disturbed 
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Figure 27. Recognition of SET2 with ten interesting points disturbed 
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number of vertices are handled here. Additionally, the svstem developed here can not 
be applied to patterns with concave boundary curves. However, the algorithm can be 
extended in these cases by using the footprint method proposed by Hummel and 


Wolfson [Ref. RIE 


D. EXPERIENCE GAINED 
The experience gained in this study can be summarized as follows. 
1. Numerical Instability 
When the interesting points of a triplet are too close to each other, the affine 
coefficients calculated based on this triplet tend to be unstable. This undesirable situ- 
ation can be avoided by applving the area test criteria in both the Preprocessing and the 
Recognition steps. 
2. Hashing Function 
The values of € and y tend to concentrate highly around the origin of the affine 
plane because they are all small numbers. These small-valued coefficients will generate 
manv long linked lists in the hash table. Hence, the accessing time will increase and 
become impractically long. Both the linear and non-linear hashing functions were tested 
in the experiments. The results show that the non-linear atan function is the best among 
many hashing functions. This function can scatter the small affine coefficients evenlv 
over a wide range of the affine plane. Consequently, the size of the linked list can be 
reduced and a desirable processing speed can be achieved. 
3. Quantization of Affine Plane 
In order to tolerate the noise perturbation on the test objects, coarser 
quantization of affine plane is desirable. After calculating the bounds on é and y, an 
appropriate table size was chosen to implement the hash table. But, there is no optimal 
hash table size that can work well for all kinds of data. In our experimental tests a 90 


x 90 table size was selected. 


Nn 
Nn 


4. Modified Hash Structure 
After quantization, every entry in the hash table is indexed by (1, }). This two- 
dimentional index 1s not a numeric kev, it needs to be converted into a numeric value to 
implement the one-dimentional hash table. However, this kind of conversion will induce 
multiple collisions in the hash table. In order to reduce these collisions, two different 
One-to-one functions were adopted to generate the numerical inkey. 
5. Partial Voting Technique 
The noise problem can be lessened bv using a coarser quantization of the affine 
plane. In addition, it is possible to improve the original matching algorithm by applving 
the partial voting technique. For every quantized affine index (i, 3), there is a corre- 
sponding eight-neighbor mesh where each bin has a different voting weight. This tech- 
nique can increase the noise tolerance in the recognition step. 
6. False Peaks of Voting Array 
As a result of the partial voting, the affine invariant matching algorithm suffers 
from the false peaks in the accumulation array. The entry which received the maximum 
votes mav not be the correct one. To overcome this problem, the top six maximum 
votes are chosen as the candidates. By going through the verification procedure the 
correct candidate can be selected. 
7. Noise Perturbation 
The original algorithm is very rigid in calculating the affine coefficients. Hence, 
it is Very sensitive to noise perturbation. From the experimental results of the improved 
algorithm, the noise tolerance shows an increase of 70% with respect to the original 
method. 
8. Speed and Complexity 
In noise free cases, the improved matching algorithm can achieve a higher speed 


than the original one when dealing with more complicated images. In noisy cases, the 


speed deteriorates due to the execuation of partial voting. But, in both cases the 
execuation time of the improved algorithm 1s still highly dependent on the number of 


interesting points involved in the test. 
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V. CONCLUSIONS AND FUTURE RESEARCH 


The object recognition is a major and difficult task 1n computer vision. The affine 
invariant matching technique proposed by Hummel and Wolfson is a new and interest- 
ing method for recognizing flat objects in a perspective projection image. Since the re- 
cognition of partially occluded objects 1s the main concern, the local point feature was 
used in the affine invariant matching algorithm. In order to reduce the’complexity of 
the algorithm, a two-step scheme was apphed. The algorithm was divided into two dif- 
ferent steps, the off-line preprocessing step and the on-line recognition Step. 

This thesis discusses the shortcomings that occurred in the original algorithm. They 
are the basis instability, the collision of hash table, and the noise problem. These 
shortcomings make the original matching algorithm impractical to deal with real images. 
The original algorithm was improved by introducing several modifications. The area test 
criteria Were used to get rid of unsuitable triplets to avoid numerical errors. The modi- 
fied hash structure clearly improved the collision problem of the hash table. The partial 
voting technique with the consideration of false peaks in the voting array increased the 
noise tolerance of the original algorithm. Finally, it was shown that the results obtained 
from the improved algorithm are much better than the results from the original method. 


Possible subjects for future study related to affine invariant matching could be: 


¢ From the probability point of view, set up an optimal model to improve the re- 


cognition performance for noisy objects. 
e Use the footprint method to implement the affine invariant curve matching. 


e Extend the affine invariant matching to handle 3-D object recognition. 
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¢ Design special purpose hardware to achieve parallel searching of multiple objects 


in real time. 


APPENDIX A. PASCAL SOURCE CODE 


This appendix contains the Pascal source code used in the improved affine matching 
svstem. Explanation of each of the modules are discussed in Chapter II]. Some proce- 


dures in these programs are adapted from the original implementation [Ref. 6]. 


seavvedevcotsedecleskclescstcskcacclkskstskststeckslestrotr se PREPROCESSING seaksicacacclcakslesectestskslkeskckstksessseskeokskestrotstakoksksesicskste 
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program model_gen(output); 

(* This module generates the interesting points of data-base models, 
SET1 is used as the example *) 

(* o/p : model_interesting_ point data file *) 


type 

ary = array [ 1.) 2312.50) “of mntece:. 
var 

i,j,modelno,interestingno : integer; 


Output: TEXT; 
X,Y +: ary; 
begin 
open(output,'model_interesting point.dat' ,history := new); 
rewrite(output ); 
(* model 1 *) 
modelno := 1; interestingno : 


x[ 1,1) := 32; xi 1,2] := 36; x[1,3) 2= 383306 |e eo 
x[ 1,5] := 48; x[ 1,6] := 50; x[ 1,7] := S2;0xi ce eo 
x 1eo]) eee 
y[1,1) := 30; y[1,2] := 30; yl1;3]) := 20,0 eae 
y[ 1,5] >= 30, y[ 1,6] := 28; y{1,7)§:) > SOs eS eee 
Vie eee. 


writeln(output,modelno,interestingno); 
for i:= 1 to interestingno do 
WE Eee inCOULPUE..x|.lo a) yea |p). 
(* model 2 *) 


modelno := 2; interestingno := 7; 

x[ 2,1] := 20; x[2,2] <= 21; x[2,3])0: = 21 ee eRe 
x[2,5] := 15s &( 2,6). 4 = 19312 

yl2,1) := 31; y[2,2] := 32; yl 253). > 402 ee 
y[2,5] := 50; y[2,6] := 40; y[2,7] := 32; 
writeln(output ,modelno,interestingno); 

for 1.:>= 1] to interestingnormds 


wrate InCoutput,x| 2,41] viee er 
close(output); 
end. 


SevedededsdecdoletetetetolokecthkeedkicedckRcsentecnstledok seth RecA REG KICR 


program model_affine_calculation(input,output); 
(* This module rules out the undesirable triplets and finds all the 
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affine coefficient pair of data-base models *) 
(* i/p : model_interesting point data file 

o/p : model_affine_coefficient data file *) 
eonst 


total = 9999; 

areal = 392.0; 

area2 = 76.0; 
type 


ary = array [l..total] of integer; 


devil = array [1l..2,1..2] of reaT; 

ary2 = array [1..3] of integer; 

fmvo — array {[1l..2,1..1] of real; 

ary4 = array [1..2,1..2] of integer; 
var 


Pemmc,i1,)],Kk,index : integer; 
outmodelno,outinterestingno : array [1..10] of integer; 
modelno,tripletno,interestingno,table_size : integer; 
x,y,rest_basex,rest_basey : ary; 

inverse_matrix : aryl; 

basex,basey,comx,comy : ary2; 

Shee ecoOord : ary3;: 

base_matrix : ary4; 


procedure matrix_mult(inverse_matrix : aryl; 
Vou OtircCOord {gaia oe 


const 
k = 2; 
a= 2; 
m= 1; 
var 
i,t : integer; 
begin 
feed := 1 to 1 do 
mon al {= 1 to m do 
coord) i,il}) := 0; 
hoe 1 ;= 1 to 1 do 
Porm 11 ;= 1 to m do 
moe t := 1 to 1 do 
SoGud all) + — Coord] 1,11] + inverse -matrix{i,n] * 
alalyarél fremaaly ake 
end; 


procedure inverse(base_matrix : ary4 
var inverse_matrix : aryl); 


var 
det : real; 
begin 
fee a >= 1 to 2 do 
det := (base_matrix[1,1] * base_matrix[2,2]) - 


(base_matrix[ 1,2] * base_matrix[ 2,1] ); 
meecdet <> 0.0) then 
begin 
inverse_matrix[ 1,1] 
inverse_matrix[ 1,2] 
inverse_matrix[ 2,1] 
inverse_matrix[ 2,2] 


base_matrix[ 2,2] /det; 
base_matrix[1,2] * (-1) /det; 
base_matrix[2,1] * (-1) /det; 
base_matrix[1,1] /det; 


lot te tl 


6] 


end; 
end; 


procedure calculate_coord(basex,basey : ary2); 


var 
i,m,i)j12,13 2 antecer, 
begin 
fOr i == to 2 do 
begin 
base_matrix[1,i] := basex[i] - basex[i+1]; 
base_matrix[2,i] := basey[i] - basey[ i+1]; 
end; 
inverse(base_matrix,inverse_matrix); 
ie = ol: 
for i:= 1 to interestingno do 
begin 
if ((basex[1] <> x[ i] ) or (basey| 1) <> ya) jemand 
((basex[ 2] <> x[i]) or (basey[ 2} <> y/o ean 
((basex[ 3] <> x[i]) or (Cbasey| 3] <> yl 1) ))eenen 
begin 
rest_basex[i2] := x[i]; 
rest_basey[i2] := y[i]; 
V2 4 = 2a 
end; 
end; 
for i := 1 to (interestingno[3) do 
begin 
difif[1,1)° := rest_basex(a) s-sbasiex|s)|- 
Gdifft|/ 2,1) := rest_basey| i) = basey| si. 
matrix_mult(inverse_matrix,diff,coord); 
Counc. =" Count +1. 
i3 := count mod (interestingno-3); 
Lf i3 = 1 then tripletno := tripletne te: 
write(output ,modelno,tripletno,coord/ 1,1} ,coord|2 
for 116) = ittocs “do 
write(output ,basex[il] ,basey[i1] ); 
writeln(output); 
end; 
end; 


procedure perm(basex,basey : ary2; 
Kemi Gece ri: 
var 
lox wey s> anbecer: 
begin 
if k = 3 then 
calculate_coord(basex,basey) 


else 
fOr bask co 37do 
begin 

tx := basex[i]; 
ty := basey[i]; 
basex[ i] := basex[k]; 
basey[i] := basey[k]; 
basex[k] := tx; 
basey[k] := ty; 





perm( basex,basey,kt1); 
end; 
end; 


procedure area_test(comx,comy : ary2;i: integer); 


Ver 


s,a,b,c,sarea,area : real; 
begin 
a := sqr(comx[ 2] [ comx[ 1] )tsqr(comy[ 2] ] comy[ 1] ); 
b := sqr(comx[ 3] [ comx[ 2] )+sqr(comy[ 3] ] comy[ 2] ); 
c¢ := sqr(comx{ 1} [ comx[ 3] )+sqr(comy[ 1] ] comy[ 3] ); 
a:= sqrt(a); 
bee= sqrt(b); 
c := sqrt(c); 
See= (atbt+c )/2.0; 
if i= 1 then area := areal; 
if i <> 1 then area := area2; 
sarea := s*(s-a)*(s-b)*(s-c); 
Sarea := sqrt(sarea); 
area := area/20. 0; 


if (sarea > area) then 
perm(comx,comy,1); 
end; 


procedure comb(k,index,j : integer); 

var 
1: integer; 

begin 
if index > 3 then area_test(comx,comy, j) 
else 


for i:= k to interestingno do 
begin 


comx[ index} := x[ i]; 
comy[ index] := i 
oe J; 
Como iti sindextl, 7); 
end; 
end; 


begin(* main *) 


open( input, 'model_interesting point.dat' ,history : 


reset(intput); 


open(output, 'model_affine_coefficient. dat’ ,history : 


rewrite(output); 

table_size := 0;j:= 1; 

while not eof(input) do 
begin 


readln( input ,outmodelno[ j] ,outinterestingno[ 3] ) 


modelno := outmodelno[ j]; 

interestingno := outinterestingnol j]; 

for i:= 1 to interestingno do 
readin(input ,x[ i] ,y[ i] ); 

eount -=O0;tripletno := 0;3 := j+1; 

comb(1,1,modelno); 

table_size := table_size + count; 
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old): 


new); 


end; 
writeln(output,table_size,outmodelno[ 1] ,outinterestingno[ 1], 
outmodelno[ 2] ,outinterestingno| 2] ); 
close( input); 
close(output); 
end. 


Tavkaeksdeseakseseoksedkakakakeakeakeskeakakeaktdeakaksedkeakeakakokvaeakokske kok skeskokdkedkeskeokoaksk deve ese sealed desea se ake ese desk akeak te ae ak ake vee 


program model_inkey(input,output); 
(* This module quantizes the affine plane into 8100 different bins and 
converts each bin index (i, j) to an inkey *) 
(* i/p : model_affine_coefficient data file 
o/p : inkey data file *) 
type 
inrec = record 
modelno,tripletno : integer; 
keyl,key2 : real; 
basexl1,baseyl,basex2,basey2,basex3,basey3 : integer 
end; 
var 
b : inrec; 
infile,outfile : text; 
k1,k2,dk,inkeyl : real; 
i sjs21,j31,S1Z¢,prim,inkey + integer: 


procedure prime(var a: integer); 
var 
i,b: integer; 
begin 
bi =. Gruncia, 2): 
fOr vis=>2 to b do 
begin 
it Ga mod.1i) =-0" then 
begin 
ant =4g =]. 
prime(a); 
end; 
end; 
end; 


begin(* main *) 
open (input, 'model_affine_coefficient. dat’ ,history:=old); 
reset(input); 
open (output, 'inkey. dat‘ ,history: =new); 
rewrite(output); 
iL 20; 
while not eof(input) do 
begin 
readln( input); 
Os makes. 
end; 
close(input); 
open (input, 'model_affine_coefficient. dat’ ,history:=old); 
reset( input); 
il := 1; 
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dk := 2. O*arctan(20. 0)/90. 0; 
size 2= jl = 1; 
prim := size; 
prime(prim); 
writeln(output,size,prim); 
while il <> j1 do 
with b do 
begin 
readln( input ,modelno,tripletno,keyl,key2, 
basexl,baseyl,basex2,basey2,basex3,basey3); 
kl := arctan(keyl)/dk; 


k2 := arctan(key2)/dk; 
if (kl >= 0.0) then 
begin 
jec= trunc( kl) + 46; 
if (i > 90) then i := 90; 
end; Sees 
cfeeckl = 0.0) then 
begin 
ioe eTuUne kljs + 45: 
ieee sl) ehene 17s =); 
end; 
af (k2 >= 0.0) then 
begin 
jer ChUNG( KZ) + 46; 
fete JO) chen } := 90; 
end; 
if (k2 < 0.0) then 
begin 


ieee rune jet 45; 
fej cel) then j := 1; 
end; 

inkeyl := (0. 839*i + 0. 364*j)*100; 

inkey := trunc(inkeyl); 

WEncein( output, Inkey, °2,1:2, :>2,}:2,modelno: 2, 
tripletno,keyl,key2,basexl,baseyl,basex2, 
basey2,basex3,basey3); 

alee J): 

end; 
close( input); 
close(output); 
end. 


seokvededededsdcsdedvvededededesedededessdeskvdedcksakedeskskdeskdededkededkkkcdeaededkdeakdcsedescsedesededeskcdesdkvsdesdedcakskesdkcadvske dese sk akeske desk ak se sk 


program hashing(input,output); 
(* This module uses the inkey to generate the hashkey and sets up 
the hash table *) 
(* i/p : inkey data file 
o/p : hash_table data file *) 
const 
database_modelno = 2; 
type 
rec = record 
inkey,i,j},modelno,tripletno,link : integer; 
keyl,key2 : real; 


basexl,baseyl,basex2 ,basey2,basex3,basey3 : 


end; 
outrec = record 


hashkey, inkey,i,},modelno,tripletno, link : 


keyl,key2 : real; 


basexl,baseyl,basex2,basey2,basex3,basey3 : 


end; 
Var 
8 2: array! 0.99999) of Gutter. 
bys rec: 
11,12, 71,32,k2,table_ size. prime 


G iarray| 0.99999) sot integer, 


procedure print; 
var 
i2 : integer; 
begin 
for i2 := 0 to table_size - 1 do 
begin 
if a[i2].hashkey <> - 1 then 
with a[i2]} do 


writeln(output ,hashkey,inkey,  >2012 25 eee 
modelno: 2,tripletno:4,keyl,key2,basex1: 4, 


integer; 
outmodelno,outinterestingno : array [1..database_modelno] 


of integer; 


a2 


baseyl: 4, basex2:4,basey2: 4,basex3: 4,basey3: 4, link) 


end; 
end; 


procedure col lision( var m,n 2 aimtecer)- 


begin 
while a[m].link <> - 1 do 
m:= a[{m]. link; 
n= mee A 
while a[n].hashkey <> - 1 do 
begin 
ns = il 


if n > table size - 1 thenn: 


end; 
atm]. link := n; 
a[n}.hashkey := n; 
ain). ankey «= —b, inkey, 


alin = ise De: 

Snag e = bag, 
a[n].modelno := b.modelno; 
a[n].tripletno := b.tripletno; 
a[n].keyl := b. keyl; 
af[n].key2 := b. key2; 
a[n].basexl := b. basexl; 
a[n].baseyl := b. baseyl; 
a[n].basex2 := b. basex2; 
af{n].basey2 := b. basey2; 
a(n]. basex3 := b. basex3; 
a[n].basey3 := b. basey3; 


end; 
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procedure initialize; 


var 
ie: integer; 
begin 
for il := 0 to table_size - 1 do 
begin 
af il].hashkey := - 1; 
al ii|2 linkes= = I; 
Cl ib] 2 ="0; 
end; 
end; 


procedure insert(var m,n : integer); 
begin 
if (af[m].hashkey = - 1) then 
begin 
a[m].hashkey :=m; 
a[m].inkey := b. inkey; 


a[m].i := b.i; 
aml | 2= D..35 
af{m].modelno := b.modelno; 
a{m].tripletno := b.tripletno; 
a[m].keyl := b. keyl; 
a[m].key2 := b. key2; 
a[m].basexl := b. basexl; 
a{m].baseyl := b. baseyl; 
a[m].basex2 := b. basex2; 
a{m].basey2 := b. basey2; 
a[m].basex3 := b. basex3; 
alm]. basey3 := b. basey3; 
en) := 1; 
end; 
end; 


begin (* main *) 
Seen (input, inkey. dat’ ,history := old); 
reset(input); 
open (output, hash_table.dat',history := new); 
rewrite(output); 
readln(input,table_size,prim); 
writeln(output,table_size,prim); 
initialize; 
je —0; 31 := - 1; 
while not eof(input) do 
begin 
with b do 
begin 
readin(input,inkey,i,j},modelno,tripletno,keyl,key2, 
basexl,baseyl,basex2,basey2,basex3,basey3); 
11 := inkey rem prin; 
end; 
fe = 11 +l; 
posert( 11,71); 
end; 

close( input); 
open (input, inkey. dat' ,history := old); 
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reset( input); 
a2 2S503 )2 0 S=— ake — 90, 
readln( input ,table_size,prim); 
while not eof(input) do 
begin 
with b do 
begin 
readln( input, inkey,i,j,modelno,tripletno,keyl,key2, 
basexl,baseyl,basex2,basey2,basex3,basey3); 
i2 := inkey rem prin; 
end; 
+ oe 
= 0 then 
lon r25kZ): 
end; 
close( input); 
px dae 
close(output); 
end. 
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program test_gen(output); 
(* This module generates the interesting points of test objects *) 
(* o/p : test_interesting point data file *) 
type 
ary = (array (1..2,1.750)) of integer 
var 
i,j},modelno,interestingno : integer; 
X,Y: ary; 
begin 
open(output,'test_interesting point.dat' ,history : 
rewrite(output); 
(* test object *) 
modelno: =1; interestingno := 10; 


new); 


x[ 14) 3= 503: x[ 1,2) 2 = "40,7 xi iio. 

xia] 2S 10 xp ss] 2 = 10; 

x[ 1,6] := 20; x[1,7] := 30: x{ 1,8) 9] 30: [eo 
x{. P20) 2 = 40; 

Yi Petes 10; yee) 0; eS al 

¥(1,4)0: = 10S yi) 2 = 40, 

y[1,6] := 40; y[1,7] := 50; y[1,8] := 30; y[1,9] := 30; 


Viele Cie s— a 20e 
writeln(output,modelno, interestingno); 
for i::= 1 to interestinenogde 
writeln(interesting,x/1,i] ,y[1,i]); 
close(output); 

end. 


sevedesesedesedesevevevevedesedtesevedededesededesedevesededededsdetedeteteteketedestetehtedetedesedededoksedededeceditesekkedvdccededetek vevede 


program test_affine_calculation(input,output); 

(* This module rules out the undesirable triplets and finds all the 
affine coefficient pair of test objects *) 

(* i/p : test_interesting point data file 
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o/p : test_affine_coefficient data file 
eonst 

matal =.9999; 

Barea = 533.0; 
Eype 


ary = array [1..total] of integer; 


aeyl = array [1..2,1..2] of reail; 

ary2 = array [1..3] of integer; 

ary3 = array [1..2,1..1] of real; 

Qeyo = array {[1..2,1..2} of integer; 
var 


count,i,k,index : integer; 


z) 


modelno,interestingno,table_size : integer; 


x,y,rest_basex,rest_basey : ary; 
inverse_matrix : aryl; 
basex,basey,comx,comy : ary2; 
Gait ,coord : ary3; 

base_matrix : ary4; 


procedure test_matrix_mult(inverse_matrix : aryl; 
Var sdiheneOord = (aryo)¢ 
const 
ke — 2; 
ie— 2; 
m= 1; 
var 
weet, Tl integer; 
begin 
for :;= 1 to | do 
for j := 1 to m do 
eord| i,j) := 0; 
hornet := 1 to i do 
mer j :=— 1 to m do 
hore *— 1 to 1 do 
Soorclist) += coord|i,4]) + inverse_matrix[i,n] * 
ls Del| TSE 
end; 
procedure test_inverse(base_matrix : ary4; 
var inverse_matrix : aryl); 
var 
det : real; 
begin 
feet += 1 to 2 do 
det := (base_matrix[1,1] * base_matrix[2,2]) - 
(base_matrix[1,2] * base_matrix[2,1] ); 
fc aet <> 0.0) then 
begin 
inverse_matrix[ 1,1] := base_matrix[ 2,2] /det; 
inverse_matrix[1,2] := base_matrix[1,2] * (-1) /det; 
inverse_matrix[2,1] := base_matrix[2,1] * (-1) /det; 
inverse_matrix| 2,2] := base_matrix[1,1] /det; 
end; 
end; 
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procedure test_calculate_coord(basex,basey : ary2); 
var 
1,j, 11,426 aneecer: 
begin 
fOrel 2:= 176o 2 do 
begin 
base_matrix[1,i] := basex[i] - basex[ it1]; 
base_matrix[2,i] := basey[i] - basey[it+1]; 
end; 
test_inverse(base_matrix, inverse_matrix); 
126 3S a le 
for i1:= 1] to interestingno do 
begin 


if ((basex[1] <> x[i]} or (basey[1] <> y[i])) and 
(Cbasex[ 2} <> x[i]) or (basey[2] <> y[i])) and 
((basex[ 3] <> x[i]) or (basey[3] <> y[i])) then 
begin 
rest_basex[ i2] 
rest_basey[ i2] 
2 6 =) a2, th 
end; 
end; 
nal 2 6 Gig ier 
begin 
al B09 | UE Les | 8 rest_basex[i] - basex[ 3]; 
daek tie. rest_basey[i] - basey[ 3]; 
test_matrix_mult(inverse_matrix,diff,coord); 
COUN, = — count +1: 
write(coordinate,modelno,count,coord[1,1] ,coord[ 2,1] ); 
for als = 1lrte 3.de 
write(output, basex[ il] ,basey[il] ); 
writeln(output); 
end; 
end; 


— 
— 
— 
— 


4 esl 
Ae 


1 to interestingno[ 3 do 


procedure test_perm(basex,basey : 
k : integer); 


ary 2; 


var 
te ys 
begin 
if k = 3 then 
test_calculate_coord( basex,basey) 


integer; 


else 
fori —= k-Co3 do 

begin 
tx := basex[ i]; 
ty := basey[ i]; 
basex[i] := basex[k]; 
basey[i] := basey[k]; 
basex[k] := tx; 
basey[k] := ty; 
test_perm(basex, basey,k+1); 

end; 

end; 
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procedure area_test(comx,comy : ary2); 


var 
s,a,b,c,sarea,area : real; 
begin 
a := sqr(comx[ 2] [ comx[ 1] )+sqr(comy[ 2] ] comy[ 1] ); 
b := sqr(comx[ 3] [ comx[ 2] )+sqr{(comy[ 3} ] comy[ 2] ); 
c := sqr(comx[ 1} [ comx[ 3] )+sqr(comy[ 1] ] comy[ 3] ); 
a := sqrt(a); 
b := sqrt(b); 
c := sqrt(c); 
S$ := (a + b + c)/2.0; 
sarea := s*(s[a)*(s]b)*(Cs[c); 
sarea := sqrt(sarea); 
area := tarea/10.0; 


if (sarea > area) then 
test_perm(comx,comy,1); 
end; 


procedure comb(k,index : integer); 


var 
i: integer; 
begin 
if index > 3 then area_test(comx,comy) 
else 
for i:= k to interestingno do 
begin 
comx[ index] := x[ i]; 
comy[ index] := y[i]; 
ecombCit!, indext] ); 
‘end; 
end; 


begin(* main *) 
open(input,'test_interesting point. dat’ ,history := old); 
reset( input); 
open(output, 'test_affine_coefficient. dat’ ,history := new); 
rewrite(output); 
table_size := 0; 
while not eof(input) do 
begin 
readln( input ,modelno,interestingno); 
writeln(output,interestingno); 
for i:= 1 to interestingno do 
meadIn(anput,x| 1] ,yi wie; 
eount :=0; 


comb ( 1.1); 
table_size := table_size + count; 
end; 
close( input); 
close(output); 
end. 
sevetedededevetesesedesesesedededesedededededede de Ree KR TR IR I TEER TRRETR EER EREEEREEESERERUC ER 


program test_inkey(input,output); 
(* This module converts every bin index (i, j) to an inkey and generates 


a 


the tally data files) 
(* i/p : test_affine_coefficient data file 
o/p : tally data file *) 
type 
inrec = record 
modelno,tripletno : integer; 
keyl,key2 : real; 
basexl,baseyl,basex2,basey2,basex3,basey3 : integer 
end; 
var 
bo inrec: 
iMmtple,outtite = Foxe: 
dk Kivk2¢inkeyl 7: .réal. 
i,il,j,interestingno,inkey : integer; 
begin 
open (input,'test_affine_coefficient. dat’ ,history: =old); 
reset( input); 
open (output,'tally.dat' ,history: =new); 
rewrite(output); 
ilo = 0- 
readln(input,interestingno); 
writeln(output,interestingno); 
dk := 2. 0*"arctan( 20. 0)/90. 0; 
while not eof(infile) do 
Ween bo GO 
begin 
readln(infile,modelno,tripletno,keyl,key2, 
basexl,baseyl,basex2,basey2,basex3,basey3); 
kl := arctan(keyl1)/dk; 
kK278="areran Key 2) ak: 
LEcC ki c="0.0)" then 
begin 
* = trinc( kl) seo. 
if (i> 90) then 1). — 90; 
end; 
Pt CK e020) stnen 
begin 
i fe se runek)) 7 aero: 
ff (10 <1) -thenwe— a. 
end; 
if (k2 >= 0.0) then 
begin 
j 2 = tEunc( KZ) sao; 
if (j= 90) ethens7 2 — 0. 
end; 
it eC Z eo OO es then 
begin 
1 2 = rune ( k2) +°45: 
if ¢j < 1) then j := 1; 


end; 
inkeyl. := (0: 839*1 + 0: 3644) *100: 
inkey := trunc(inkeyl); 


writeln(output,inkey,i,j,keyl,key2, 
basexl,baseyl,basex2,basey2,basex3,basey3); 
14": = ea 
end; 


close(infile); 
close(outfile); 
end. 


Heaeskhaededededededevede Heese de sede Fede ae Tere He He Fete Tevet Fe We Ue Te Fe Fe Tete Ve VEN He Fe Fee He He ENE Vee He Fee Fe He eC Fee HI TCH He He MITE HE 


program affine_matching(input ,candfile,output); 

(* This module applies partial voting technique to select all the 
entries which satisfy the top[six]max criteria *) 

i* i/p : hash_table and tally data files 
o/p : vote data file *) 


const 
database_modelno = 2; 
type 
candrec = record 
inkey,i,j : integer; 


keyl,key2 : real; 
basexl,baseyl,basex2,basey2,basex3,basey3 : integer; 
end; 

modelrec = record 
hashkey,inkey,i,j,modelno,tripletno,link : integer; 
keyl,key2 : real; 
basex1,baseyl,basex2,basey2,basex3,basey3,a : integer; 
end; 

collected_modelrec = record 
hashkey,inkey,i,j,modelno,tripletno,link : integer; 
keyl,key2 : real; 
basexl,baseyl,basex2,basey2,basex3,basey3,a : integer; 
votel : real; 
end; 

var 

temporary_model,temp : array[0..9999] of modelrec; 

model : array [0..23000] of modelrec; 

collected_model : array[{1..9999] of collected_modelrec; 

tmodel,smodel,gmodel,pmodel : array[{1..1000] of collected_modelrec; 

cand: array(|0..19999] of candrec: 

mamai,cand2 : array [1..9999] of candrec; 

tcand,scand,gcand,pcand : array[1..1000] of candrec; 

meni. k,kKl,m,4andex,count ,n,prim,f,h,g,hkey,ix,iy,jx,jy,cl,c2 : integer; 

maxl11,max12,max13,max14,max15 ,max16 

max21 ,max22 ,max23,max24 ,max25 ,max26 

mal,th2z : real; 

table_size,interestingno,test_interestingno_3, 

fib 2,S1,S2,w,tl,t2 : integer: 

candfile : text; 

vote : array[0..database_modelno,0..27999] of real; 

outmodelno,outinterestingno : array [1..database_modelno] of integer; 


procedure initializel; 


var 
a) : integer; 
begin 
for 1:= 0 to database_modelno do 
for } := 0 to table_size do 
vote[i,j] := 0.0; 
end; 
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procedure print(i6,k : integer); 
begin 
with gmodel[i6] do 
begin 
writeln(output ,hashkey, inkey,modelno: 2,tripletno: 4, 
keyl,key2,basex1:4,basey1:4,basex2: 4,basey2: 4, 
basex3: 4,basey3: 4,votel,k); 
gcand[i6].keyl := keyl; 


gcand[ i6}].key2 := key2; 
end; 
with gcand[i6] do 
writeln(output,' ':10,inkey,' :6,keyl,key2,basexlace 
baseyl: 4, basex2: 4, basey2: 4,basex3: 4, basey3: 4); 
end; 


procedure delet(h : integer); 
var 
Ko lsdsliscd,ialswWw <) integer, 
begin 
k="): = 0: w = 0: 
while (k <= h) do 
begin 
if (smodel[k].a = 0) then 
begin 
J pe =k 
q := smodel[k]. inkey; 
for! 1 =e coh de 


gmodel[hl] := smodel|[ i]; 
gcand[hl] := scand[ i]; 
end 
else 
if (smodel[i].inkey = q) and (j <> 0) then 
smodel[i].a:= 1]; 
end; 
end; 
Kaa et le 
end; 
if (gmodel[1].modelno = 1) and (hl >= tl) then 
begin 
for ls = aware: Wide 
epaonouel bial) 
end; 
if (gmodel[1].modelno = 2) and (hl >= t2) then 
begin 
fone =. 1 tosniedo 
DE in CG lege) 
end; 
end; 
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procedure selectl(pl : integer); 


var 
k,q,h,i : integer; 
begin 
Kee — 1: 
while(k <= pl) and (sl = 0) do 
begin 
if (tmodel[k].a = 0) then 
begin 
h := Q; 
q := tmodel[k].tripletno; 
fOnei.:— lL to pl do 
begin 
if (tmodel[i].tripletno = q) then 
begin 
he = he 1; 
smodel[h] := tmodelf i]; 
scand[h] := tcand[ i]; 
tmodel[i].a := 1; 
end; 
end; 
if (h >= tl) then 
delet(h); 
end; 
kK:=k + 1; 
end; 
end; 


procedure select2(pl : integer); 


var 
k,q,h,i: integer; 
begin 
k := 1; 
while(k <= pl) and (s2 = 0) do 
begin 
if (tmodel[k].a = 0) then 
begin 
he = 20% 
q := tmodel[k].tripletno; 
ford s— 4d °to pl do 
begin 
if (tmodel[i].tripletno = q) then 
begin 
|g RS) oats aaa 
smodel[h] := tmodelf i]; 
scand[h] := tcand[ i]; 
tmodel[i].a:= 1; 
end; 
end; 
if (h >= t2) then 
delet(h); 
end; 
k:=k+4+1; 
end; 
end; 
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procedure all_maximun_selected(n : integer); 
var 


io, pl +: anvegem 
begin 
if (sl =0) then 
begin 
pl := 0; 
for 415 ==) eo nde 
with collected_model[{i5] do 
if (modelno = 1) and 
((cand2{i5].inkey <> 0) and (votel = maxll)) then 
begin 
pil = *pl + a 
tmodelf{[ pl] := collected_model{ i5]; 
tcand{[ pl} := cand2[i5]; 
end; 
selectl(pl); 
end; 
if (sl =0) then 
begin 
pio: = 0; 
LOnoL. +=. tecOlcnedo 
with collected_model{i5] do 
if (modelno = 1) and 
((cand2[i5].inkey <> 0) and (votel = maxl2)) then 
begin 
ieee = Ol Bal: 
tmodel{ pl] := collected_model{ i5]; 
tcand[ pl] := cand2{ i5]; 
end; 
selectl(pl); 
end; 
if (sl =0) then 
begin 
pl = ©; 
fOr 15.2 = Letorn, do 
with collected_model[{i5] do 
if (modelno = 1) and 
((cand2[i5].inkey <> 0) and (votel = max13)) then 
begin 
pie? = pl acl: 
tmodel[ pl] := collected_model{ i5]; 
tcand| pi} <= cand2/ iol; 
end; 
selectl(pl); 
end; 
if (sl =0) then 
begin 
ple: = 0, 
fOr. <= 1 arom ao 


with collected_model[{i5] do 
if (modelno = 1) and 
((cand2[i5].inkey <> 0) and (votel = maxl14)) then 


begin 
Die = (pia, 
tmodel{pl] := collected_modell[ i5]; 
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teand| pli: = cand2| i5] ; 
end; 
selectl(pl); 
end; 
af (si =0) then 
begin 
pl := 0; 
bores — 1 to n do 
with collected_model[i5] do 
if (modelno = 1) and 
((cand2[i5].inkey <> 0) and (votel = max15)) then 
begin 
foe =o Lect anes 
tmodel[ pl] := collected_model|[ i5] ; 
weend| pl) 2= cand2[ 15]; 
end; 
selectl(pl); 
end; 
if (sl =0) then 
begin 
eu 2= 0; 
Bor 1) := 1 to n°do 
with collected_model[i5] do 
if (modelno = 1) and 
((cand2[i5].inkey <> 0) and (votel = maxl6)) then 


begin 
ore =) dies AG 
tmodel[ pl] := collected_model|[ i5],; 
beand) pill 7= cand2/ 15); 
end; 
selectl(pl); 
end; 
if (s2 =0) then 
begin 
pits = 0; 
fou 1) :—= 1 to n do 


with collected_model[i5] do 
if (modelno = 2) and 
((cand2[i5].inkey <> 0) and (votel = max21)) then 
begin 
Ceo plot 1: 
tmodel[pl] := collected_model| i5]; 
Cana pull. ;—= cand2Z| 15]; 
end; 
selectl(pl); 
end; 
if (s2 =0) then 
begin 
pl := QO; 
Pom doge.—] 1 to n do 
with collected_model[i5] do 
if (modelno = 2) and 
((cand2[i5].inkey <> 0) and (votel = max22)) then 


begin 
ples pled 1; 
tmodel[pl] := collected_model|[ i5]; 
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tcand[ pl] := cand2{ i5]; 
end; 
selectl(pl); 
end; 
if (s2 =0) then 
begin 
pli 0; 
for 15.:= 1° to n-do 
with collected_model[{i5] do 


if (modelno = 2) and 
((cand2[i5].inkey <> 0) and (votel = max23)) then 


begin 
pls pir: 
tmodel[{pl] := collected_model|{ i5]; 
tcand[pl] := cand2[i5]; 
end; 
selectl(pl); 
end; 
if (s2 =0) then 
begin 
Biles = 30% 
FOV A554. = 1 oansdo 
with collected_model[i5] do 
if (modelno = 2) and 
((cand2[i5].irkey <> 0) and (votel = max24)) then 
begin 
pig pi? 1; 
tmodel[ pl] := collected_model[ i5]; 
tcand[pl1] := cand2[ i5]; 
end; 
selectl(pl); 
end; 
if (s2 =0) then 
begin 
pi: =a. 
for A 5a7— letounsdo 
with collected_model[{i5] do 
if (modelno = 2) and 
((cand2[i5].inkey <> 0) and (votel = max25)) then 
begin 
jo}: eae, oe gs ele 
tmodel[{ pl] := collected_model[ i5]; 
tcand({pl|] := cand2[45F. 
end; 
selecriGp lt 1: 
end; 
if (s2 =0) then 
begin 
Die — <0; 
for 415... —-1) CO 1. do 


with collected_model[i5] do 


if (modelno = 2) and 
((cand2[i5].inkey <> 0) and (votel = max26)) then 


begin 
Dl 2260 le: 
tmodel[pl] := collected_model{[ i5]; 
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tcand[ pl] := cand2[i5]; 


end; 


selectl(pl); 


end; 
end; 


procedure verify(jl,k,m : 


var 
i4,q : 
begin 
for i4 


integer; 


-= | to m do 


with temporary_model[i4} do 
if (modelno = temporary_model[k].modelno) and 


end; 


procedure top_six_maximun(m : 


var 


integer;var n: integer); 


(tripletno = temporary_model[k].tripletno) then 


begin 
n:=nt+t 1; 
collected_model[n].hashkey := hashkey; ta 
collected_model[n].inkey := inkey; 
collected_model[n].modelno := modelno; 
collected_model[n].tripletno := tripletno; 
collected_model[n].keyl := keyl; 
collected_model[n].key2 := key2; 
collected_model[n].basexl := basex]l; 
collected_model[n].baseyl := baseyl; 
collected_model[n].basex2 := basex2; 
collected_model[n].basey2 := basey2; 
collected_model[n].basex3 := basex3; 
collected_model[n].basey3 := basey3; 
collected_model[n].votel := vote[modelno,tripletno] ; 
for q := (jl - test_interestingno_3) to jl - 1 do 


if (abs(cand[q].keyl - keyl) < 0.04) and 
(abs(cand[q].key2 - key2) < 0.04) then 
cand2[n] := cand[q]; 


end; 


i3 : integer; 
real; 


max : 
begin 

max := 

mor 13 


0,0; 
>= 1 to m do 


0: 


integer;var k: integer); 


with temporary_model[i3] do 
if (vote[modelno,tripletno] > max) then 


begin 

k :=i3; 

max := vote[ modelno,tripletno] ; 

if (modelno = 1) then 

begin 

if (max > maxll) then 
maxll := max 

else 

if (max <> maxll) and (max > max12) then 
maxl2 := max 

else 
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if ((max <> maxll) and (max <> maxl2)) and (max > max13) then 
maxl3 := max 
else 
if ((max <> maxll) and (max <> maxl2))} and ((max <> max13) and 
(max > maxl14)) then 
maxl4 := max 
else 
if (((max <> maxll) and (max <> maxl2)) and ((max <> max13) and 
(max <> maxl4))) and (max > maxl15) then 
maxl5 := max 
else 
if ((max <> maxll) and (max <> maxl2)) and ((max <> maxl3) and 
(max <> maxl4)) and ((max <> maxl15) and (max > maxl6)) then 
maxl6 := max; 


end; 

if (modelno = 2) then 

begin 

if (max > max21) then 
max2] := max 

else 

if (max <> max21) and (max > max22) then 
max22 := max 

else 

if ((max <> max21) and (max <> max22)) and (max > max23) then 

max23 := max 
else 


if ((max <> max21) and (max <> max22)) and ((max <> max23) and 
(max > max24)) then 
max24 := max 
else 
if (((max <> max21) and (max <> max22)) and ((max <> max23) and 
(max <> max24))) and (max > max25) then 
max25 := max 
else 
if ((max <> max21) and (max <> max22)) and ((max <> max23) and 
(max <> max24)) and ((max <> max25) and (max > max26)) then 
max26 >= max. 


end; 
end; 
end; 
procedure search(hkey,i,j,f : integer;var m: integer); 
var 
i2. 2  -1ntecer: 
begin 
i2 := hkey; 
while (i2 <> {1) do 
begin 
if (i = model{i2].i) and 
(j = model[{i2].j) then 
begin 
M i=) oes 
temporary_model[{m] := model[ i2]; 
with temporary_model{m] do 


begin 
Vite) then 


80 


vote[ modelno,tripletno] 
if = 2) ehen 
vote[ modelno, tripletno] 
if f = 3 then 
vote[ modelno,tripletno] 
end; 
end; 
i2 := model[i2]. link; 
end; 
end; 


procedure partial(prim,i,j,f : 
var 


inkey,hkey : integer; 
inkeyl : real; 
begin 
inkeyl := (0.839*i + 0. 364%*j)*100; 
inkey := trunc(inkeyl); 
hkey := inkey rem prin; 


Beamen(nkey,i,},£,m); 
end; 


begin(* main *) 


open (input,'hash_table.dat' ,history : 


reset( input); 


integer; var m: 


open (candfile,'tally. dat’ ,history : 


reset(candfile); 
een (ret, ref.dat' ,history : 
reset(ref); 


open (output, vote.dat' ,history : 


rewrite(output); 
readlin(input,table_size,prim); 
readlin(candfile,interestingno); 
mead in(ref,thl,th2); 
test_interestingno_ 3 : 
maitializel; 
mee — trunc(th1); 
eee — trunc(th2); 
ies 0; Jj] := O:k1 :=1;cl: 
while not eof(input) do 
begin 
with model[il1] do 


olay: 


vote[modelno,tripletno] + 1.0; 
vote[modelno,tripletno] + 0.5; 


vote[modelno,tripletno] + 0. 25; 


integer); 


eld): 
Olas 


new); 


interestingno - 3; 


readlin( input ,hashkey,inkey,i,j},modelno,tripletno,keyl,key2, 
basexl,baseyl,basex2,basey2,basex3,basey3, link); 


sl ea eke 


mee = O;k :=1:n : 
(spartial voting *) 
while not eof(candfile) do 
begin 
with cand] j1] do 
begin 


Os fees 


oJ, 


readlin(candfile,inkey,i,j,keyl,key2,basexl,baseyl, 
basex2,basey2,basex3, basey3); 


hkey := inkey rem prim; 
search(hkey,i,j,f,m); 


8] 


1x 


=i. 1; 
iy += iste 
jx = aee 

= J aes 


Ie Ss 

if ((i > 0) and (1 < 91)) and ((jx > 0) and ( jx] oe 
PaLrtial@pram.4 jx, 2,m)s 

if ((i > 0) and (i < 91)) and (Ciy > 0) and (jy seo 
partial(prim,i,jy,g,m); 

if ((ix > 0) and (ix < 91)) and ((j > 0) and (j= oa en 
Parteiaueprim, ix. 1,210): 

if (Ciy > 0) and (iy < 91)) and ((j > 0) and Gj s<soip eee 
partial(prim-iyig cm); 

if ((iy > 0) and (iy < 91)) and ((jx > 0) and (jx =< 9I)jmae 
partial(prim,iy, jx,h,m); 

if ((iy > 0) and (iy < 91)) and ((jy > 0) and (jy = 9) eure 
partial(prim,iy,jy,h,m); 

if ((ix > 0) and (ix < 91)) and ((jy > 0) and (jy sso ea 
Parietal prim, 1x, )y¥ s,m 

if (Cix > 0) and (ix < 91)) and ((jx > 0) and (jm —s cpp ed 
Dartial@prim, ix x, lem), 


end; 
oe ee 
count := jl mod test_interestingno_3; 
if count = 0 then 
begin 
top_six_maximun(m,k); 
verify(jl,k,m,n); 
m:= QO; 
initializel; 
end; 
end; 


all_maximun_selected(n); 
close(input); 
close(candfile); 
close(ref); 
close(output); 

end. 
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program reconstruct(input,vote,ploting); 
(* This module does the inverse affine transformation to calculate 
the interesting point sets of the qualified candidate triplets *) 
(** i/p : model_interesting point and vote data files 
o/p : ploting data file *) 


Conse 
totalmodelno = 2; 
type 
aryl = array [1..10] of integer; 
ary2 = array [1..999] of integer; 
ary = sdrray. | 1.99] *OLemealt 
ary4 = array [1..10,1..99] of integer; 
ary5 = array [1..3] of integer; 
ary6 = array | 1..2,1..2] of invever. 
ary? = array [12.2, 1.22] “cf cea. 


anvee—varcay [lec 2,1... 1} of real; 

var 
orimodelno : aryl; 
select_basex,select_basey,test_basex,test_basey,rest_basex, 
rest_basey : ary2; 
hashkey,inkey,modelno,tripletno : integer; 
recogmodelno,recoginteresting,vot,a : integer; 
collected_keyl,collected_key2,votl : real; 
test_recogx,test_recogy,ordered_test_inter_coordx, 
ordered_test_inter_coordy, 
ordered_test_basex,ordered_test_basey : ary3; 
X,y,oriinterestno : ary4; 
metex,Ority :; ary 5; 
base_matrix : ary6; 
inverse_matrix : ary/; 
oer ,coord : ary8; 
deletemodelno : array [0..totalmodelno] of integer; 
vote,ploting : text; 
korder,jr : integer; 
i: integer; 


procedure matrix_mult(inverse_matrix : ary/7; 
Var Giit,coord ¢ ary): 


const 
k = 2; 
1 = 2; 
m= 1; 
var 
mil ,n : integer; 
begin 
hor i := 1 to 1 do 
for eil := 1 to m do 
coord[i,il] := 0; 
for i :<= 1 to | do 
tor ah ?= 1 te,m ido 
fOErane1— 1 to 1 do 
€eo07d| 1,11) 9:— Coord | a.41) "-einverse matrix|i,n] * 
da ffi nyaee|: 
end; 


procedure inverse(base_matrix : ary6; 


var 
inverse_matrix : ary/7); 
var 
det : real; 
begin 
det := (base_matrix[1,1] * base_matrix[2,2]) - 
(base_matrix[1,2] * base_matrix[ 2,1] ); 
if (det <> 0.0) then 
begin 
inverse_matrix[1,1] := base_matrix[ 2,2] /det; 
inverse_matrix[ 1,2] := base_matrix[1,2] * (-1) /det; 
inverse_matrix[2,1] := base_matrix[2,1] * (-1) /det; 
inverse_matrix[2,2] := base_matrix[1,1] /det; 
end; 
end; 
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procedure calculate_coord(recogmodelno : integer; 
cbasex,cbasey : ary5); 
var 
1M, 11,125 oe ec em: 
begin 
for*i-?= tee ado 
begin 
base_matrix[1,i] := cbasex[i] - cbasex[ i+1]; 
base_matrix[2,i] := cbasey[{i] - cbasey[ i+l]; 
end; 
inverse(base_matrix,inverse_matrix); 
eS ee 
for i:= 1 to oriinterestno[ orimodelno[ recogmodelno] , 
recogmodelno] do 
begin 
if ((cbasex[1] <> x{ recogmodelno,i] ) 
or (cbasey[1] <> y[ recogmodelno,i])) and 
((cbasex[ 2] <> x[{ recogmodelno, i] ) 
or (cbasey[{2] <> y{recogmodelno,i] )) and 
((cbasex[ 3] <> x[{ recogmodelno, i] ) 
or (cbasey[3] <> y{ recogmodelno,i] )) then 
begin 
rest_basex[{i] := x{[ recogmodelno, i]; 
rest_basey[i] := y[ recogmodelno, i]; 
diff[1,1] := rest_basex[i] - cbasex[ 3]; 
diff{[2,1] := rest_basey[i] - cbasey[ 3]; 
matrix _mult( inverse_matrix,diff,coord); 
ordered_test_inter_coordx|[ i] :=coord[ 1,1] * 
(ordered_test_basex[ 1] [ ordered_test_basex] 2[ )+ 
coord[ 2,1] *(ordered_test_basex[ 2] - 
ordered_test_basex[ 3] )+ 
ordered_test_basex|{ 3]; 
ordered_test_inter_coordy[ i] : =coord[{1,1]* 
(ordered_test_basey[ 1] [ ordered_test_basey] 2[ )+ 
coord[ 2,1] *(ordered_test_basey| 2] - 
ordered_test_basey| 3] )+ 
ordered_test_basey| 3] ; 
end; 
end; 
for i:= 1 to oriinterestno[ orimodelno] recogmodelno| , 
recogmodelno] do 
writeln(ploting,ordered_test_inter_coordx[ i] , 
ordered_test_inter_coordy{ i] ); 
end; 


rocedure colinear(var comx,comy : ary5; 
Var tl ,t2 + realy, 


var 

colinearxl,colinearx2,colinearyl,colineary2 : integer; 
begin 

colinearxl := comx[2] - comx[ 1]; 

colinearx2 := comx[3] - comx[ 2]; 

colinearyl] 7= comy(| 2) - conv ae 

colineary2 := comy[3] - comy[ 2]; 


if (colinearxl <> 0) then 
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. 
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tl := arctan(colinearyl / colinearx1]1) 
else tl := 1.5707; 
if (colinearx2 <> 0) then 


t2 := arctan(colineary2 / colinearx2) 
else t2 := 1.5707; 
end; 
procedure pretest(i,j : integer; 
Varibint2): real): 
var 
count : integer; 
begin 
count := 1; 


while ((test_recogx| j]<>0) or (test_recogy[ j]<>0)) and 
(count < 4) do 
begin 
oritx[ count]:=x[i,j]; 
erary| count]: =yil 1,7); 


ordered_test_inter_coordx[ j] := test_recogx[ j]; 
ordered_test_inter_coordy[j] := test_recogy[ j]; 
ordered_test_basex[ count] := test_recogx[ j]; 
ordered_test_basey[ count] := test_recogy| j]; 
J) teeta 
eount == <count+tl; 
end; 
Sorimear(oritx,ority,tl,t2Z); 


end; 


procedure mapping(bx,by : real; 
var ordering : integer; 
i: integer); 
var 
j : integer; 
begin 
for } := 1 to oriinterestno| orimodelno[ i] ,i] do 
begin 
Hei CabsCpxe-ex| 1, ]| )) = 0, 00001) and 
(abs(by - y[i,j]) < 0.00001) then 
ordering := j; 
end; 
end; 


procedure interest; 
var 
ivi: integer; 
begin 
open(input,'model_interesting_ point. dat’ ,history := old); 
reset(input); 
open(ploting, 'ploting. dat’ ,history := new); 
rewrite(ploting); 
i:=1; 
while not eof(interesting) do 
begin 
read( interesting,orimodelno|[ i] ); 
readlin(interesting,oriinterestno| orimodelno[ i] ,i] ); 
for j := 1 to oriinterestno[ orimodelno[ i] ,i] do 


readln(interesting,x[ orimodelno[ i] ,j], 
y[ orimodelno[ i] , j] ); 
1 3=) ie 
end; 
end; 


procedure recognized; 
var 
i,115425 13) ee eecer: 
select_model_tempx,select_model_tempy,t1l,t2 : real; 
begin 
open (vote, vote. dat ,histery =: — olay: 
reset(vote); 
1 :=1; 
while (not eof(vote)) do 
begin 
readln(vote,hashkey, inkey,modelno,tripletno,collected_keyi, 
collected_key2, 
select_basex[ 1] ,select_basey[ 1] ,select_basex[ 2], 
select_basey|[ 2] ,select_basex[ 3] ,select_basey[ 3] ,votl,a); 
readln( vote, inkey,collected_keyl,collected_key2, 
test_basex[1] ,test_basey[1] ,test_basex[ 2] , 
test_basey[ 2] ,test_basex[ 3] ,test_basey| 3] ); 
recogmodelno := modelno; 
if (votl/(oriinterestno[ orimodelno[ recogmodelno] , recogmodelno] -3) >= 0.5) th 
begin 
for J: =) te 3 do 
begin 
mapping(select_basex[ j] ,select_basey[ j] ,jr, 
recogmodelno); 
test_recogx[ jr] test_basex[ j]; 
test_recogy[ jr] test_basey[ j]; 
end; 
select_model_tempx := collected_keyl*(select_basex[ 1] - 
select_basex[ 2] )+ collected_key2*(select_basex[ 2] - 
select_basex[ 3] )+select_basex[ 3]; 
select_model_tempy := collected_keyl*(select_basey[ 1] - 
select_basey[ 2] )+ collected_key2*(select_basey| 2] - 
select_basey[ 3] )+select_basey|[ 3]; 
mapping(select_model_tempx,select_model_tempy, jr, 
recogmodelno); 
test_recogx[ jr] := collected_keyl*(test_basex[ 1] - 
test_basex[ 2] )+ 
collected_key2**(test_basex[ 2] -test_basex[ 3] ) 
+test_basex[ 3]; 
test_recogy[ jr] := collected_keyl*(test_basey/[ 1] - 
test_basey[ 2] )+ 
collected_key2*(test_basey/[ 2] -test_basey[ 3] ) 
+test_basey| 3]; 
for ji = 1 tosal lode 
begin 
readln(vote,hashkey, inkey,modelno,tripletno, 
collected_keyl,collected_key2, 
select_basex[ 1] ,select_basey/[1] ,select_basex[ 2], 
select_basey[ 2] ,select_basex[ 3] ,select_basey| 3] ); 
readln(vote,inkey,collected_keyl,collected_key2, 
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test_basex[1] ,test_basey[ 1] ,test_basex[ 2] , 
test_basey[ 2] ,test_basex[ 3] ,test_basey[ 3] ); 
select_model_tempx := collected_keyl*(select_basex[ 1] - 
select_basex[ 2] )+ collected_key2*(select_basex[ 2] - 
select_basex[ 3] )+tselect_basex[ 3] ; 
select_model_tempy := collected_key1*(select_basey[ 1] - 
select_basey[ 2] )+ collected_key2*(select_basey[ 2] - 
select_basey| 3] )+select_basey{ 3]; 
mapping(select_model_tempx,select_model_tempy, jr, 
recogmodelno); 
test_recogx[ jr] := collected_keyl*(test_basex[ 1] - 
test_basex[ 2] )tcollected_key2* 
(test_basex[ 2] -test_basex[ 3] )+test_basex] 3[; 
test_recogy[ jr] := collected_keyl*(test_basey[ 1] - 
test_basey[ 2] )tcollected_key2* 
(test_basey|{ 2] -test_basey[ 3] )+test_basey] 3]; 
end; 
writeln(ploting, recogmodelno,oriinterestno[ 
orimodelno[ recogmodelno] ,recogmodelno] ); 
11: =1; t1: =1; t2:=1; 
pretest(recogmodelno,il,t1l,t2); 
if tl<>t2 then calculate_coord(recogmodelno, 


OLX ,Or icy) 
else 
pretest(recogmodelno,iltl,t1,t2); 
end; 
end; 


end; 


iegin(* main *) 
interest; 
recognized; 
end. 
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